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Abstract. A category of Brauer diagrams, analogous to Turaev's tangle cate- 
gory, is introduced, and a presentation of the category is given; specifically, we 
prove that seven relations among its four generating homomorphisms suffice to 
deduce all equations among the morphisms. Full tensor functors are constructed 
from this category to the category of tensor representations of the orthogonal group 
0(V) or the symplectic group Sp(V) over any field of characteristic zero. The first 
and second fundamental theorems of invariant theory for these classical groups are 
generalised to the category theoretic setting. The major outcome is that we obtain 
new presentations for the endomorphism algebras of the module V® r . These are 
obtained by appending to the standard presentation of the Brauer algebra of de- 
gree r one additional relation. This relation stipulates the vanishing of an element 
of the Brauer algebra which is quasi-idempotent, and which we describe explicitly 
both in terms of diagrams and algebraically. In the symplectic case, if dim V = 2n, 
the element is precisely the central idempotent in the Brauer subalgebra of degree 
n + 1, which corresponds to its trivial representation. Since this is the Brauer 
algebra of highest degree which is semisimple, our generator is an exact analogue 
for the Brauer algebra of the Jones idempotent of the Temperley-Lieb algebra. 
In the orthogonal case the additional relation is also a quasi-idempotent in the 
integral Brauer algebra. Both integral and quantum analogues of these results are 
given, the latter of which involve the BMW algebras. 
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1. Introduction 



The fundamental theorems [W] of classical invariant theory are concerned with 
generators and relations for invariants of classical group actions, and can be for- 
mulated in different ways [GWj. A linear formulation [W] of the first and second 
fundamental theorems describes a spanning set of the vector space of invariant lin- 
ear functionals on tensor modules, and all the linear relations among the elements 
of this set. There is also a commutative algebraic formulation which describes the 
invariants of classical group actions on the coordinate ring of an appropriate module 
|G Wj . The fundamental theorems in this case give a presentation of the algebra of 
invariant functions as a commutative algebra. The two formulations are equivalent. 

Another formulation, which is more frequently encountered in representation the- 
ory, is in terms of the (non-commutative) endomorphism algebras of tensor modules. 
The first fundamental theorem (FFT) in this formulation |G W] describes the endo- 
morphism algebra as the homomorphic image of some known algebra, which is the 
group algebra of the symmetric group in the case of the general linear group fol- 
lowing Schur, and the Brauer algebra |Brj with appropriate parameters in the case 
of the orthogonal or symplectic group by work of Brauer. However, except in type 
A (GL n ) there does not seem to exist a standard form of the second fundamental 
theorem (SFT) in this formulation. A reasonable expectation is that the SFT should 
provide convenient presentations for these endomorphism algebras, which cannot be 
deduced from the other two formulations of the SFT in any easy way, except in the 
case of the general linear group. Since there is a large (non-commutative) algebra 
of endomorphisms, one might expect that there should be only a small number of 
relations necessary to generate the ideal of all relations, other than the "Brauer re- 
lations" . This does indeed turn out to be the case, with a single explicitly described 
idempotent generating all additional relations as an ideal of the Brauer algebra. 

These results permit an analysis of the generic quantum case, which we present, 
and should lead to results for quantum groups at roots of unity, and for the case 
where the base field has positive characteristic. This is because our generating 
elements in both cases are sums of diagrams with coefficients ±1. 

In |LZ2^ [LZ3] . the orthogonal group O(V) over C with dim V — 3 was investigated 
(together with its quantum analogue at generic q). We obtained a single idempotent 
E in the Brauer algebra of degree r > 4, which generates a two-sided ideal that 
is equal to the kernel of the algebra homomorphism from the Brauer algebra to 
the endomorphism algebra End(W)(^® r ) (the kernel is trivial if r < 4). Thus 
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Endo(v)(V r ® r ) can be presented in terms of the standard generators and relations of 
the Brauer algebra with the single additional relation E = 0. 

Remarkably, the situation has turned out to be the same for all the orthogonal 
groups [LZ4] and symplectic groups [HX] over any field K of characteristic zero. 
The methods used in the papers \LZ2\ ILZ3[ ILZ4] and |HX] are quite different. In 
|LZ2[IL~Z3] . we analysed the radical of the Brauer algebra to prove our result, making 
extensive use of the theory of cellular algebras |GL96[ IGL03t IGL04] . The paper |HXj 
relied on results on the detailed structure and representations |DHW[ IHW[ IRSj IX] 
of the Brauer algebra and BMW algebra [BW]. In particular, it made essential use 
of a series of earlier papers of Hu and collaborators. In contrast, invariant theory 
featured much more prominently in |LZ4] . 

In the present paper we give a unified treatment of the SFTs for all the or- 
thogonal and symplectic groups in the endomorphism algebra formulation, fol- 
lowing a categorical approach inspired by works on quantum invariants of links 
[JllTTllRl lRTllZUB] . 

Recall that a key algebraic result in quantum topology is that the category of 
tangles is a strict monoidal category with braiding \FY1\ \FY2\ ITlj (also see \KT\ 
IT2] ) in the sense of Joyal and Street jJSj. The set of objects of this category is 
N = {0, 1, 2, . . . }, and the vector spaces of morphisms have bases consisting of non- 
isotopic tangle diagrams. We define a similar, but much simpler category 13(5), the 
category of Brauer diagrams with parameter 5 G K. The space of morphisms of 13(5) 
is spanned by Brauer diagrams (see Definition I2.ip . which include the usual Brauer 
diagrams [Br] as a special endomorphisms of an object of the category. 

Let G be either the orthogonal group O(V) or the symplectic group Sp(V), 
and denote by Tg(V) the full subcategory of the category of finite dimensional 
G-representations with objects V® r (r 6 N). There exists an additive functor 
F : B(em) — > Tg(V), which is given by Theorem I3.41 Here em = e(G) dimV 
with e(G) = 1 for 0(V) and —1 for Sp(K). The functor F is shown to be full in 
Theorem 14.8( 1). This significantly generalises the FFTs for the orthogonal and sym- 
plectic groups. Both the linear and endomorphism algebra versions of FFT are now 
special cases of Theorem 14.8( 1). and their equivalence becomes entirely transparent. 

For each pair of objects r, s in the category B(em), the functor F induces a linear 
map F* : Hom e ( Em )(r, s) — > H.om.j- G ( V - ) (V® r , V® s ). A simple description of the 
subspace KerF^ is obtained in Theorem 14.8( 2). which contains the linear version of 
SFT special case. 

When s = r, the domain of F£ is the Brauer algebra of degree r, the range is the 
endomorphism algebra End7^,(y)(V r ^ r '), and the map is an algebra homomorphism. 
In this case, we want to understand the algebraic structure of the kernel of the map 

f;. 

We explicitly construct an element in the Brauer algebra which generates KerF r r 
as a two-sided ideal (KerF T r ^ only when r > d, see Theorem 14.61) . The result for 
the symplectic group is given in Theorem 15.91 and that for the orthogonal group in 
Theorem 16.101 This leads to a presentation of Endjg^y^V® 1 ") upon imposing the 
condition that this element vanishes. In the case of 0(V), the generating element 
we obtain is shown to be equal to that obtained in [LZ4j . In the symplectic case, the 
element of [HXJ is a scalar multiple of the one obtained here (Remark l5.10l) . However 
our approach yields an explicit formula for the element, both in terms of generators 
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and relations, and in terms of diagrams; moreover we show that the element is (a 
multiple of) the central idempotent corresponding to the trivial representation of 
the Brauer algebra on n + 1 strings, if r = 2n. We note that B r (—2n) is semisimple 
if and only if r < n + 1 (see §[7] below). Thus our generating element is an exact 
analogue of Jones' 'augmentation' idempotent pi IGL98J. 

We remark that notwithstanding the fact that convenient formulae for our gen- 
erating elements involve rational numbers with large denominators, the elements 
are actually sums of diagrams with coefficients ±1. This permits reduction modulo 
primes, and an approach to the case of positive characteristic (§7]). 

The category of Brauer tangle diagrams provides an appropriate framework for 
uniformly treating the SFTs of the orthogonal and symplectic groups in the endo- 
morphism algebra formulation because to move between the linear, commutative 
algebraic and endomorphism algebra formulations, we need to consider arbitrary 
Brauer diagrams, not only those in the Brauer algebras. 

The categorical framework is also the most natural setting for studying the invari- 
ant theory of quantum groups [DHL]- In Section [5^1 we present some generalisations 
of our results to the quantum case, where we show that similar results hold, with 
the Brauer algebras replaced by the Birman-Murakami-Wenzl algebras. 

2. The category of Brauer diagrams 

We begin with a discussion on Brauer diagrams, which could be thought of as a 
highly simplified version of the tangle diagrams of |FYlllFY2|ITl] (also see [RT| IT2] ) . 
Tangles in this paper are neither oriented nor framed. In fact we shall find it easier 
to work with the (equivalent) category of Brauer diagrams, with no reference to 
tangles. 

2.1. The category of Brauer diagrams. Let N = {0, 1, 2, . . . }. 

Definition 2.1. For any pair k, £ e N, a (k, £) (Brauer) diagram, (or Brauer diagram 
from k to £) is a partitioning of the set {1, 2, . . . , k + £} as a disjoint union of pairs. 

This is thought of as a diagram where k + I points (the nodes, or vertices) are 
placed on two parallel horizontal lines, k on the lower line and £ on the upper, with 
arcs drawn to join points which are paired. We shall speak of the lower and upper 
nodes or vertices of a diagram. The pairs will be known as arcs. If k — £ — 0, there 
is by convention just one Brauer (0, 0)-diagram. 

Figure [T] below is a (6,4) Brauer diagram. 




Figure 1. 



Remark 2.2. Such a diagram may be thought of as the image of a tangle diagram 
(i.e. ambient isotopy class of (k,£) tangles) under projection to a plane. It is 
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straightforward that if overcrossings and undercrossings are identified in a tangle 
projection, the only invariants of a tangle are the number of free loops and the set 
of pairs of boundary points, each of which is the boundary of a connected component 
of the tangle. Hence the identification with Brauer diagrams. We shall therefore 
not use tangles explicitly. 

There are two operations on Brauer diagrams: composition defined using concate- 
nation of diagrams and tensor product defined using juxtaposition (see below). 

Definition 2.3. Let K be a commutative ring with identity, and fix 5 G K. Denote 
by Bf.(8) the free K- module with a basis consisting of (k,£) Brauer diagrams. Note 
that B k {5) 7^ if and only if k + £ is even, since the free i^-module with basis the 
empty set is zero. By convention there is one diagram in Bq(5), viz. the empty 
diagram. Thus Bq(6) = K. 

There are two i^-bilinear operations on diagrams. 



These operations are defined as follows. 

(1) The composite D\ o D 2 of the Brauer diagrams D\ G B^(S) and D 2 G B k {5) 
is defined as follows. First, the concatenation D\j^D 2 is obtained by placing 
D\ above D 2 , and identifying the i lower nodes of D\ with the corresponding 
upper nodes of D 2 . Then D\j^D 2 is the union of a Brauer (k,p) diagram D 
with a certain number, f(D\, D 2 ) say, of free loops. The composite D\ o D 2 
is the element 5 f{Dl '° 2) D G B p k (5). 

(2) The tensor product D <g> D' of any two Brauer diagrams D G B!*(5) and 
D' G B l k (S) is the (p + k,q + I) diagram obtained by juxtaposition, that is, 
placing D' on the right of D without overlapping. 

Both operations are clearly associative. 

Definition 2.4. The category of Brauer diagrams, denoted by B(S), is the following 
pre-additive small category equipped with a bi-functor <g> (which will be called the 
tensor product): 

(1) the set of objects is N = {0,1,2,...}, and for any pair of objects k, I, 
Homg(j)(fc, I) is the i^-module B l k (5); the composition of morphisms is given 
by the composition of Brauer diagrams defined by (12.11) : 

(2) the tensor product k <g> I of objects k, I is k + I in N, and the tensor product 
of morphisms is given by the tensor product of Brauer diagrams of (12. ip . 

It follows from the associativity of composition of Brauer diagrams that B(S) is 
indeed a pre-additive category. 

Remark 2.5. The operations in B(5) mirror the operations in the tangle category 
considered in [FY1[ IFY2[ ITU IRTl IT2j and the category of Brauer diagrams is a 
quotient category of the category of tangles in the sense of [Ml §11.8]. 



(2.1) 



composition o : BJ(S) x B k (5) 
tensor product <g> : B*(5) x B k (5) 




BUM 
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2.2. Involutions. The category 13(5) has a duality functor* : 13(5) — > B(5) op , which 
takes each object to itself, and takes each diagram to its reflection in a horizontal 
line. More formally, for any (k, £) diagram D, D* is the (£, k) diagram with precisely 
the same pairs identified as D. Further, there is an involution " : 13(5) — > 13(5) which 
also takes objects to themselves, but takes a diagram D to its reflection in a vertical 
line. Formally, if the upper nodes of the diagram D are labelled 1,2. ... ,£ and the 
lower nodes are labelled 1', 2', . . . , k', we apply the permutation i y £ + 1 — z, j' \— y 
k + 1 — f to the nodes to get the arcs of DK We shall meet the contravariant functor 
D^*D := D*°* later. 

It is easily checked that (D 1 o D 2 )* = D\ o £>*, (D x <g> D 2 )* =D{® and that 
(Dt o D 2 f = D\ o D\ and (D 1 ® D 2 f = D\® Hi 

2.3. Generators and relations. Generators and relations for tangle diagrams 
were described in |FY1[ IFY2[ ITT[ IRT| IT2j . The corresponding result for Brauer 
diagrams is the main result of this section. 

Theorem 2.6. (1) The four Brauer diagrams 




generate all Brauer diagrams by composition and tensor product (i.e., jux- 
taposition). We shall refer to these generators as the elementary Brauer 
diagrams, and denote them by I, X , A and U respectively. Note that these 
diagrams are all fixed by " ; and that * fixes I and X , while A* = U and 
U* = A. 

(2) A complete set of relations among these four generators is given by the fol- 
lowing, and their transforms under * and K This means that any equation 
relating two words in these four generators can be deduced from the given 
relations. 



(2.2) Iol = 1, (I <g) I) o X = X, (I <g> I) o A = A, (I ® f) o U = U, 

(2.3) XoX = I, 

(2.4) (X ® I) o (/ ® X) o (X <g> I) = (I ® X) o (X ® I) o (I ® X), 

(2.5) AoX = A, 

(2.6) A o U = 5, 

(2.7) (A®r)o(I®X) = (I®A)o(X<g>I) 

(2.8) (A®I)o(I®U) = I. 



The relations (I2.3p - (I2.8p are depicted diagrammatically in Figures^ and |7J 

Proof. We first prove (1). The fact that the elementary Brauer diagrams I,X, A 
and U generate all Brauer diagrams under the operations of o and Cg> may be seen as 
follows. Fix the nodes of an arbitrary diagram D from k to £, and draw all the arcs as 
piecewise smooth curves, in such a way that there are at most two arcs through any 
point, and that no two crossings or turning points have the same vertical coordinate. 
We may now draw a set of horizontal lines (possibly after a small perturbation of 
the diagram) such that 
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Double crossing Braid relation 

Figure 2. Relations Q and fl2^j) 




De-looping Loop Removal 
Figure 3. Relations (J2HS and f!2^|) 




Sliding Straightening 
Figure 4. Relations (E7J) and (EHD 



(i) each line is not tangent to any of the arcs 

(ii) between successive lines there is precisely one crossing or turning point. 
Then the part of the diagram between successive lines may be thought of as the 

^-product of the four generators, all except one being equal to /. Thus we have 
exhibited Dasa word in the generators, of the form D = D\ o _D 2 ° • • ■ ° D n , where 
each Di is of the form 

(2.9) Di = I® r <8> Y <8> I®% 

with Y being one of A, U or X. Such an expression will be called a regular expression, 
and the factors Di elementary diagrams. A product of elementary diagrams in which 
Y = X for each factor will be called a permutation diagram. An example of a 
particular regular expressions is given in Figure [51 
This completes the proof of (1). 

We now turn to the proof that the stated relations form a complete set. Observe 
first that any expression for a diagram D as a word in the generators provides a reg- 
ular expression for D by repeated use of the relation (I2.2p and its dual. Accordingly 
we say that two regular expressions D, D' are equivalent, and write 2) ~ D' if one 
can be obtained from the other by a sequence of applications of the relations in part 
(2) of the Theorem. This is clearly an equivalence relation on regular expressions. 
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Figure 5. Regular expression 

However, a word in the generators does not in general yield a Brauer diagram, 
but rather a diagram multiplied by 5 k for some nonnegative integer k, where k is the 
number of deleted loops. For any Brauer diagram D and any iV G Z + , the above 
argument shows that we can always represent 5 N D as a word in the generators, and 
hence also as a regular expression. We therefore need to work with morphisms of 
the form 5 N D, where D is a diagram. We refer to such a morphism as a scaled 
Brauer diagram, or simply a scaled diagram. Every Brauer diagram is clearly a 
scaled diagram. 

The discussion above shows that to prove the Theorem, it will suffice to show that 

(2.10) Any two regular expressions for a scaled diagram are equivalent. 

We shall extend the notion of equivalence to any expression of the form Di o ■ ■ - o 
D n , where the are diagrams. 

Definition 2.7. The two compositions D x o • • • o D n and D[ o • • • o D' m are said 
to be equivalent if one can be obtained from the other using only the relations in 
Theorem 12.61 (2). and the properties of o and ®. 

To prove (12.101) we require some analysis of regular expressions and equivalence. 
We shall return to the proof after carrying this out. □ 

Definition 2.8. (1) The valency of scaled diagram D G B\ is the pair (k,l). 

(2) If D = I® r ®K8 I® s is elementary, the abscissa a(D) of D is r + 1, while 
the type t(D) = Y (= A, U or X). 

(3) The length of a regular expression E\ o ■ ■ ■ o E n is n. 

We shall repeatedly apply the following elementary observation, which we refer 
to as the "commutation principle" . 

Remark 2.9. (1) Let Ei,E 2 be elementary diagrams such that E\ o E 2 makes 
sense. If |a(#i) - a(E 2 )\ > 1 then E 1 o E 2 ~ E[ o E' 2 , where t(E[) = t(E 2 ) 
and t(E' 2 ) = t(E x ). 

(2) If D, D' are scaled diagrams of valency (k, I) and (k', I') respectively, then 
D®D' = {I® 1 <g> D') o(D(g) I® k ') = (D® I® 1 ') o (I® k <g> D'). 

Part (2) of the Remark states the obvious relations among diagrams depicted in 
Figure E They follow from the fact that (A <g> B) o (A' ® B') ~(Ao A') <g> (B o 5') 
for A, A', B, B' of appropriate valency, and the relation (12. 2p . 

The next two results will be used in the reduction of the proof of Theorem 12.61 (2) 
to a single case. 
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D D' 



D' 



D 



D 



D' 



Figure 6. Commutativity 



Lemma 2.10. Let P,Q be permutation diagrams of valency (1,1) and (k,k) respec- 
tively and let D e B l k be a scaled diagram. If any two regular expressions for PoDoQ 
are equivalent, then so are any two regular expressions for D . 

Proof. Let 23, 23' be two regular expressions for D, and suppose for the moment 
that P is an elementary permutation diagram. Then P o 23 and P o 23' are regular 
expressions for P o D, and hence are equivalent by hypothesis. Now P o P o 23 is a 
regular expression, and it is evident that PoPoD is equivalent to P o P o 23'. But 
from (12. 3p . PoPoD ~ 23 and P o P o 23' ~ 2)', whence S3 and 23' are equivalent. 
This proves the Lemma for elementary P and Q = id. 

Applying the above statement repeatedly, we see that for any permutation dia- 
gram P, if any two regular expressions for P o D are equivalent, the same is true for 
D. A similar argument applies to prove the corresponding statement for D o Q, for 
any permutation diagram Q. □ 



It follows that in proving (I2.10p . we may pre- and post-multiply D by arbitrary 
permutation diagrams, and replace D by the resulting scaled diagram. 
For the second reduction, we require the following definitions. 



Definition 2.11. (1) Define R : B[ ->■ B l +_\ (for k > 1) (the raising operator) 
by R(D) = (D(g)/)o(/®( fc - 1 )(8)[/), and (the lowering operator) L : B l k -> Sj^ 
by L(D) = (J®^- 1 ) ® A) o (D ® J). 
(2) If 23 = Di o D 2 o ■ ■ ■ o D n is a regular expression for the scaled diagram 
Z3 G define the regular expression R(D) for -R(-D) by R(D) = (Di g) 
J) o (_D 2 ® /) o • • • o (D n <g> J) o (/® fc_1 (g) [/) ; and similarly define the regular 
expression L(2)) for L(D). Note that if is elementary, then so is E <8> J, so 
that the above definition makes sense. 



Lemma 2.12. (1) For any regular expression 23 /or a scaled diagram D e 
we /iawe i? o L(23) ~ 2) and L o i?(23) ~ 23. 
(2) Suppose D is a scaled diagram of valence (k,l) with k > 1. Tne regular 
expressions 23,23' /or Z3 are equivalent if and only if L(D) and L(D') (or 
i?(23) ana 1 i?(23') j are equivalent. 



10 



G.I. LEHRER AND R.B. ZHANG 



Proof. To prove (1), let 3) — E\ o ■ ■ ■ o E n be a regular expression for D G B l k . Then 
R o L(D) = Rdl^-V ® A) o {E l ® J) • • • o (E n <g> 7) 

= (J^C- 1 ) <g, A g> /) o (Ei <g> / <g) /) • • • o (E n <g) /) o J® fc <g> C/ 

~ (gj A <8> J) o (7 0i ® U) o o • • • o E n by several applications of 

~ I® 1 o E 1 o • • • o £ n by q> 

~ E 1 o • ■ • o E n by 

= D. 

This shows that i? o ~ 2), and the proof that L o R(D) ~ £> is similar. 

Now to prove (2), suppose first that 2), D' are equivalent regular expressions for 
D. Then the same sequence of moves using the relations in Theorem 12.61 (2) which 
convert T) into D' may be applied to L(D) to convert it into L(D'). This shows 
that if D, D' are equivalent regular expressions for D, then L(D),L(D') are equiv- 
alent regular expressions for L(D). A similar argument proves the corresponding 
statement for R(D). 

To prove the converse, suppose that any two regular expressions for R(D) are 
equivalent, and that Di and 2) 2 are two regular expressions for D. Then R(Di) and 
R(T>2) are two regular expressions for R(D), and hence by hypothesis are equivalent. 
Hence by the above, LoR(T>\) and LoR(Q 2 ) are two equivalent regular expressions 
for L o R(D), which is equal to D by (1). But by (1), L o R(Di) ~ Di and 
L o R(D 2 ) ~ £2, whence Di ~ D 2 - □ 

The following lemma is the key computation involving the relations in Theorem 
EH (2). 

Lemma 2.13. Let% s := E s oE s _io- ■ -oE be a regular expression, wheret(E ) = U, 
a(Eo) = a, t(Ei) = X and a{Ei) = a + % for i > 1. The diagram T s is shown in 
Figure Let E be an elementary diagram of type A or X which does not 'commute 
with 7 E s o E s ^i o ■ ■ • o Eq, i.e. such that a — 1 < a(E) < a + s + 1. Then 

(1) Ift(E) = A, then E o% s is equivalent to a shorter regular expression unless 
s = and a(E) = a(Eo). In the latter case, £oI s is the identity multiplied 
by 5. 

(2) Suppose t(E) = X ; then 

(i) if a + 1 < a(E) < a + s — 1, then E o % s ~ % s o E' for an elementary 
diagram E' of type X . (Thus E may be 'moved through' E o % s ). 

(ii) if a(E) = a or a + s, then E o r £ s is equivalent to a shorter regular 
expression. 

(Hi) if a(E) = a — 1 or a + s + 1 then E o % s ~ % 8 +x- 

(3) Let % s be as above and let E be elementary of type A or X . Then E o % s 
is equivalent to a shorter regular expression (possibly multiplied by 5) or to 
% s o E' for some elementary E' , or to % s +\. 

Proof. Consider first the case where t(E) = A. 

If s = and a(E) = a(E ), the claim follows from the loop removal relation (12.61) . 

Ifa(E) = a + s + 1, then applying ([ZTjl . EoE s ~ E'oE' s , where t(E') = t(E) = A, 
t(E' s ) = t(E s ) = X, a(E') = a + s and a(E' s ) = a + s + 1. It now follows by repeated 
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application of Remark 12.91 about commutation, that E o T s ~ E" o o E'", where 
t(E") = A and a(E") = a + s. Repeating this argument s times, we see that £oI s 
is equivalent to a regular expression of length s + 1 which includes F o Eq as a 
subexpression, where t(F) = A and a(F) = a + 1. Applying (I2.8p . we see that 
F o E ~ J' 8 ' 2 for some fc, and hence o % s is equivalent to a regular expression of 
length s — 1. 

If a(i?) = a + s, then by (I2.5p . E o E s ~ E, and we have again shortened E o £ s . 

If a < a(-E') < a + s — 1, then by commutation, EoI s is equivalent to a regular 
expression with a subexpression of the form E o Ei o E^i, where t(Ej) = X and 
a(E) = a(Ei) — 1. Applying (12.81) . this is equivalent to an expression E' o E[ o Ei-i, 
where a(E'A = a(E^i), and t{E'A = X. Using either Q (if z > 1) or the * of fl23D . 
we again reduce the length to show that E o T s is equivalent to a shorter regular 
expression. 

Finally if a(E) = a — 1, we use commutation to show that E o T s is equivalent to 
a regular expression of length s + 1 with a subexpression of the form E' o E , where 
t(E') = A and a(E') = a - 1 = a(£ ) - 1- Applying (12^]) . we see that E' oE ~ J® fc 
for some fc, and this completes the proof of (1). 

Now consider the case where t(-E) = X. 

If a + 1 < a(E) < a + s — 1, then after applying the commutation rule, E o T s is 
equivalent to a regular expression of length s + 1 which has a subexpression of the 
form E o E a (E)+i ° E a ^ E y But using the braid relation (12.41) . this is equivalent to 
E' o E a ( E ) o E a ( E ) + i, where E' = E a ^ E \ + i. Again using commutation, we may now 
move the last factor below E (since a(E) + l > a+2). It follows that Eo% s ~ ZgoE', 
where t(E') = X. This proves (i). 

If a(E) = a + s + 1 then evidently E o T s = T s+ i. If a(_E) = a + s, the relation 
XoX = J®/ (12. 3p shows that EoE s ~ /® r for some r, and hence Eo% s is equivalent 
to a shorter regular expression. If a(.E') = a — 1, then we may use commutation to 
see that E o T s ~ E s o • • • o E% o F o Eq . Using the relation (12.71) we see that this is 
equivalent to E s o • • • o E\ o E\ o E' , where t(E' ) = U. Applying (12. 3p . we see that 
E o T s is equivalent to a shorter regular expression. Finally, if a(E) = a, we again 
use commutation to see that E o T s is equivalent to E s o o • • • o E o E\ o E . 
Again applying (12.71) . we obtain a factor EoE, and applying (12.31) . we again shorten 
the regular expression E o % s . This completes the proof of (2). 

The statement (3) is a summary of the previous two statements. □ 

Completion of the proof of Theorem \2.b\ (2). It remains to prove (12.101) . It follows 
from Lemmas 12.121 and 12.101 that to complete the proof of the theorem, it suffices 
to prove (12.101) for any scaled diagram which can be obtained from D by raising or 
lowering, or multiplication by a permutation diagram. It follows that we may take 
D to be the scaled diagram D = 5 N U® r (N e Z + ). Hence we shall be done if we 
prove the following result. 

(2.11) Any two regular expressions for D = S N U® r are equivalent. 

We shall prove (12. lip by induction on r, starting with r = 0. For convenience, we 
adopt the following local convention: 

(1) scaled diagrams will be simply called "diagrams"; 
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(2) a regular expression D is said to be "5-equivalent" to another regular ex- 
pression D' if it can be changed to S k D' for some k G Z + by the relations in 
Theorem EH (2). 

Let r = and suppose D := D\ o ■ ■ ■ o D n is a regular expression for the empty 
scaled diagram 5 N in B®. We need to show that D is (^-equivalent to the empty 
regular expression; we do this by showing that every non-empty regular expression 
for the empty scaled diagram is (^-equivalent to one of shorter length. 

Now by valency considerations, we must have D\ = A and D n = U. Let i be the 
least integer such that t(Di) = U; then for all j < i, t(Dj) = A or X. Applying 
Lemma 12.131 repeatedly, we see that since at least one of the Dj for j < i is of type 
A, D is 5-equivalent to a shorter regular expression. This proves the result for r = 

Now take r > and let D — D\ o • • • o D n be a regular expression for D. Then 
since at least r of the Di must have type U, we have n > r. Moreover if n = r, which 
happen only if iV = 0, then the Di are all of type U, and have odd abscissa, and 
any such regular expression represents D. Any two such regular expressions (which 
will be called minimal) are equivalent by the commutation rule (see Remark 12. 9p . 

It therefore suffices to show that if n > r, then D is (^-equivalent to a shorter 
regular expression. 

Clearly we have t(D n ) = U; if t(Di) = U then S' := D 2 ° • • ■ ° D n is a regular 
expression for f/®( r_1 ) ) and we conclude by induction on r that T)' is (^-equivalent 
to a shorter regular expression. Thus we are finished. Let p = p(D) be the least 
index such that D p is of type U. We have seen that if p — 1 then we are finished by 
induction. It will therefore suffice to show that D is either equivalent to a regular 
expression T)' with p(D') < p(D), or is (^-equivalent to a shorter regular expression 
2)'. 

Thus we take p > 1; then t(D p ) = U, and t(Di) = A or X for i < p. We now 
apply Lemma 12.131 to conclude that either we may commute one of the Di {i < p) 
past D p , or Di o • • • o D p ~ or at least one of the Di {i < p) is of type A. 
In the first case, we obtain a regular expression with small p-value; in the second 
case, in the diagram D\ o ■ ■ ■ o D n if the nodes are numbered 1, 2, . . . , 2r from left to 
right, node a(D p ) would be joined to node a(D p ) + p. Hence p — 1, which has been 
excluded. 

In the third case, suppose i is the largest index such that 1 < i < p — 1 and 
Di is of type A. Then either some Dj (i < j < p — 1) can be commuted past D p 
by application of Remark (12.91) . or else we are in the situation of Lemma [2.131 (1). 
In the former case, we have reduced p; in the latter, by loc. cit. D^ o • • • o D p is 
(^-equivalent to a shorter regular expression. 

We have now shown that either D is 5-equivalent to a shorter regular expression, 
or equivalent to a regular expression which has the same length as 3) but a smaller 
p value. 

This completes the proof of (12. lip , and hence of Theorem 12.61 □ 

Remark 2.14. We note that to prove part (2) of the theorem, we could have pro- 
ceeded by regarding B(5) as a quotient category of the category of (unoriented) 
tangles (see Remark 12. 5p and deduce the relations among the generators of Brauer 
diagrams from a complete set of relations among the generators of tangles given 
in \T1\ §3.2] (suppressing information about orientation). This way we obtain all 



BRAUER CATEGORY AND INVARIANT THEORY 



13 



relations except the one which enforces the removal of free loops and multiplication 
by powers of 5, i.e., (I2.6p . 

2.4. Some useful diagrams. We shall find the following diagrams useful in later 
sections of this work. Let A q = A o (I <g> A <g> I) . . . (7^-i) g> A ® I®^- 1 )), U q = 
(j®(5-i) (g, [/ (g, /»(«-!)) o---o(I<g>U®I)oU and J 9 = J® 9 . These are depicted as 
diagrams in Figure 




Figure 7. 

We shall also need X Stt , the (s + t, s + t) Brauer diagram shown in Figure[8l 



Figure 8. 



The following result is easy. 



Lemma 2.15. (1) For any Brauer diagrams D\ G B r k [S) and D 2 € B q (5), we 
have I r o Di = Di and D 2 o I r = D 2 . That is, I r = id r for any object r of 
B{6). 

(2) The following relation holds. 



(J g ® A q ) o (U q ® J ? ) = (t^ <8) J g ) o (J, ® A g 
Corollary 2.16. For all p,q andr, define the linear maps 



W p = {-®I q )o{I p 



U q ) : B; +q (5) 



b; + «(5) 



Then W p 



R q and 



(I r+q <g> Aq) O 



<8> / ) : B. 



(see Definition \2.11\) . These are mutually inverse. 



This is clear since by Lemma [2. 121 L and R are mutually inverse. 
Let * : B q p (5) — > B^(5) be the linear map defined for any D 6 B q (5) by *D 
(I p <g) A^) o (ip <g) Z) <g) J 9 ) o (C/p <g> J ? ). The diagram *D is depicted in Figure El 




Figure 9. *D 
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Lemma 2.17. The map * coincides with the anti-involution D i-> D*°^ discussed in 
JO. That is, *D = D* oi for any diagram D. 

This is easily seen in terms of diagrams. 

2.5. The Brauer algebra. For any object r in 13(5), the set of morphisms B r r (5) 
from r to itself form a unital associative i^-algebra under composition of Brauer 
diagrams. This is the Brauer algebra of degree r with parameter 5, which we will 
denote by B r (5). The first two results of the following lemma are well known. 

Lemma 2.18. (1) For i = 1, ... ,r — 1, let Si and e« respectively be the (r, r) 
Brauer diagrams shown in Figure UTh below. Then B r (5) has the following 



Figure 10. 

presentation as K -algebra with anti-involution *. The generators are {si, e« 
i = 1,2, . . . ,r — 1} , and relations 



SiSj 



SjSi, SiCj ejSi, e^ej 



Cjd, if\i-j\ > 2, 



where the last five relations being valid for all applicable i. 

(2) The elements s±, . . . , s. r _i generate a subalgebra of B r (5), isomorphic to the 
group algebra i^Sym r of the symmetric group Sym r . 

(3) The map * of Lemma \2.11\ restricts to an anti-involution of the Brauer al- 
gebra. 



Parts (1) and (2) follow from Theorem 12.61 noting that any regular expression 
for a diagram in B r (5) contains an equal number of factors of type A and U. The 
stated relations are precise analogues of the relations in Theorem l2.6l (2). Part (3) is 
easy to prove. However we note that *S{ = s r+ i_j and *ei = e r+ i_i. This is different 
from the standard cellular anti-involution * of the Brauer algebra. 

We remark that multiplying the last relation above by on the left and using 
two of the earlier relations, we obtain 

a relation which we shall often use, together with its transform under *: CiSi-iCi = e,. 
Now we prove some technical lemmas for later use. 
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r 



Figure 11. 



Lemma 2.19. Let E e (r) = XLeSym ( — e )' CT ' cr £ B r {5), where e = ±1 and \a\ is the 
length of a. Represent S e (r) pictorially by Figure [771 
JTien i/ie following relations hold for all r. 

(!) 

















r 




r — 1 

















r - 1 



-e(r-2)!" 1 



r - 1 



(2) 









r 









-e(r - 1 - eS) 









r — 1 









(3) 



r-1 
i=0 1 









r — 1 




■1 



Proof. Part (1) generalises |LZ4l Lemma 5.1 (i)] and is a simple consequence of the 
double coset decomposition of Sym r into Syim.^ II Sym r _ 1 s r _ 1 Sym r _ 1 . Part (2) 
immediately follows from (1). Statement (3) can be obtained from (1) by induction 
on r. □ 

Remark 2.20. Symmetry considerations easily show that the second diagram on the 
right hand side of Lemma [2.191 (1) is a (r — 2)!-multiple of a Z-linear combination 
of Brauer diagrams; thus the second term is still defined over Z despite having the 
The same remark applies to similar terms appearing in Lemma 



coefficient , \.. . 

0-2)! 

12.211 and its proof. 



Lemma 2.21. Set e = — 1. Then for all k > 0, 



(2.12) 



A 



k 



--Ak{r + ^-k-l\ 



k-l 



2-2k)\~ 1 



r - 2 


1 


A 




r - 2k 
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Proof. For k — 0, the formula is an identity. The important case is k — 1, where 
the formula becomes 



(2.13) 



A 



r-2 



~-A(r - 2 



+ (r-4)!- 1 



r-2 



To prove it, we first obtain from Lemma [2.19( 1) with e = —1 the following relation. 





A 






r 


r 




r — 






V 









r - 1 



+ (r-2)!- 1 



r - 1 



Using Lemma 12.19( 2) to the first diagram on the right hand side, and applying 
Lemma 12.19( 3) and the corresponding relation under the anti-involution * to the 
second diagram, we obtain (12 . 13j) . 

The general case can be proven by induction on k. From (12.121) at k, we obtain 



1 "'1 A 








r-2 


r 


=4k(r + § — & — !) 


r-2 


+ (r-2-2k)\~ 1 




A 


I-IU-V7 

k + l 




l-IU-V 

k 




r - 2k 











Using (I2.13P in the second term on the right hand side, we arrive at the k + l case 
of (12.121) . This completes the proof. □ 



3. A COVARIANT FUNCTOR 

Let K be a field. Let V = K m be an m-dimensional vector space with a non- 
degenerate bilinear form (— , — ), which is either symmetric or skew symmetric. When 
the form is skew symmetric, non-degeneracy requires m = 2n to be even. Let G 
denote the isometry group of the form, so that G = {g G GL(U) | (gv,gw) = 
(v,w),Vv,w G V}. Then G is the orthogonal group O(V^) if the form is symmetric, 
and the symplectic group Sp(l/) if the form is skew symmetric. 

Given a basis {&i, . . . , b m } for V, let {6 l5 . . . , b m } be the dual basis of V, identified 
with V* via the map t>(G V) i-> (j) v (E V*) where (p v (x) := (v,x); thus (pi,bj) = 5ij. 

For any positive integer t, the space V® f is a G- module in the usual way: g{v\ ® 
■ ■ ■ ®v t ) = gv\ ® gv 2 <8> • • • <8> gv t . Moreover the form on V induces a non-degenerate 
bilinear form [— , — ] on V"®*, given by [v\ <g) • • • ® v t , W\ ® • • • <g) w t ] := rii=i( t 'i) w i)> 
which permits the identification of V m with its dual space V® 1 * = Hom^(l/®*, K). 

Define c G V <S> V by c = J^^! h ®bi in U <g> V. Then c is canonical in that 
it is independent of the basis, and is invariant under G. We shall consider various 
G-equivariant maps j3 : V® s — > V m for s,t G Z> . Among these we have the 
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following. 

P : V <g> V — > V ®V, v ®w h-> w <g)v, 

(3.1) C : K — >> V ® V, 1 ^ c , 

C:V®V — V K, v<g)W^(v,w). 

They have the following properties. 

Lemma 3.1. Let e = e(G) be 1 (resp. —1) if G = 0(V) (resp. Sp(V)). Denote the 
identity map on V by id. 

(1) The element Co belongs to (V <g) V) G and satisfies P(cq) = eco. 

(2) The maps P, C and C are all G-equivariant, and 

(3.2) P 2 = id® 2 , (P <g> id) (id <g> P) (P g> id) = (id g> P) (P <g> id) (id <g> P) , 

(3.3) PC* = eC, CP = e(7, 

(3.4) CC = e dim V, (C <8> id) (id g> C) = id = (id g> C)(C <g> id), 

(3.5) (C ® id) o (id g> P) = (id ® (7) o (P ® id), 

(3.6) (P g> id) o (id ®C) = (id ® P) o (C <g> id). 

Proof. Equation (13. 2p reflects standard properties of permutations, and the re- 
lations (13. 3 p are evident. We prove the other relations. Consider for example 
CC = C(J2i^i ® &i) = J2i(bi,bi)- The far right hand side is £V e = e dimV. 
This proves the first relation of (13. 4p . The proofs of the remaining relations are 
similar, and therfore omitted. □ 

Definition 3.2. We denote by Tg(V) the full subcategory of G-modules with objects 
y®r ^ r _ o, 1, . . . ), where V®° = K by convention. The usual tensor product of 
G-modules and of G-equivariant maps is a bi-functor Tg(V) x 7g{V) — > Tg(V), 
which will be called the tensor product of the category. We call 7g(V) the category 
of tensor representations of G. 

Note that Hornby® 7 ", V®*) = unless r + 1 is even. The zero module is not an 
object of 7g(V), thus the category is only pre-additive but not additive. 

Remark 3.3. The category Tg(V) is also a strict monoidal category with a symmetric 
braiding in the sense of |JS] , where the braiding is given by the permutation maps 

y®r g, y®t y y®t ^ y®r ^ v ® w ^ w ® v . 

We have the following result. 

Theorem 3.4. There is a unique additive covariant functor F : 13 (em) — > 7h(V) 
of pre-additive categories with the following properties: 

(i) F sends the object r to V® r and morphism D : k — >■ £ to F(D) : V m — > V® 1 
where F(D) is defined on the generators of Brauer diagrams by 

id y , F J J = eP, 

(3.7) 

C, F I / \ I = C; 
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(ii) F respects tensor products, so that for any objects r, r' and morphisms D, D' 
in B(em), 

F(r ® r') = V® r ® V® r ' = F(r) ® F(r'), and F(D ® D') = F(D) ® F(D'). 

Proof. We want to show that the functor F is uniquely defined, and gives rise to an 
additive covariant functor from 15 (em) to Tg(V). 

By Lemma 13. 1[ the linear maps in f)3.7p are all G-module maps, and by Theorem 
12.6( 1). the above requirements define F on all objects of B(em); it is clear that F 
respects tensor products of objects. As a covariant functor, F preseves composition 
of Brauer diagrams, and by (ii) F respects tensor products of morphisms. It remains 
only to show that F is well-defined. 

To prove this, we need to show that the images of the generators satisfy the 
relations in Theorem |2j)]J2]) . This is precisely the content of equations fl3.4p - fl3.6l) in 
Lemma 13. 1( 2). 

Hence for any morphism D in B(em), F(D) is indeed a well defined morphism in 
T G (V). □ 

Remark 3.5. The functor F is a tensor functor between braided strict monoidal 
categories. 

Lemma 3.6. Let H l s = Rom G (V® s , V m ) for all s,teN. 

(1) The K-linear maps 

FW p := (- ® id?)(id«P ® F(U q )) : H; +q — ► H^, 
FA r q := (idf ® F(A q ))(~ ® K q ) ■ H r p + i — )- H r p+q 

are well defined and are mutually inverse isomorphisms. 

(2) For each pair k,£ of objects in B(em), the functor F induces a linear map 

(3.8) Ft : B e k (em) — ► H* = Hom G (V^, V®*), D ^ F(D), 

and the following diagrams are commutative. 

B;+«(em) -X B; +q (em) B; +q (em) B^(em) 



p+q p+q 



pr + q 



H T+ i H r H r H r+q 

V FA r q P+1 P+1 FV P p ' 

Proof. Part (1) follows by applying the functor F to Corollary 12.161 using Theorem 
[321 

Now for any D G B r p +q (em), A r q (D) = (I r+q ® A q ) o (D ® I q ). Since F preserves 
both composition and tensor product of Brauer diagrams, 

F(A r q (D)) = (idf +9) ® F(A q ))(F(D) ® idp) 
= FA r q (F(D)). 

This proves the commutativity of the first diagram in part (2). The commutativity 
of the other diagram is proved in the same way. □ 

We shall require the next lemma, which is surely well known. Nevertheless, we 
supply a proof by adapting some computations in [ZGBj to the present context. 
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Lemma 3.7. For any endomorphism L £ Endx(V g,r ) define the Jones trace J{L) 
by 

(3.9) J(L) = F(A r ) o (L g> idf) o F([/ r ) £ End^A") ~ X, 

where A r and U r are the capping and cupping operations defined above. Then 
Tr(L,V® r ) = e r J{L). 

In particular, if L — F(D), for D £ B r r {ern), we have 

Tr (F(D), V® r ) = e r A r o (D ® J r ) o f/ r := J(D). 

T/ie map J : B r r (em) K is referred to as the Jones trace on the Brauer algebra. 

Proof. Let L £ End^(K 0r ). Since (13. 9p is linear in L, it suffices to prove it for 
L = L\ ® . . . ® L r , where Li £ Eik1r:(V) for each i. Now observe that if we write 
r : End K (V & ) -> End x (V® (i - 1) ) for the map defined by 

T(M) = (id^~ 1} <g> F(A)) o (M <g> idy) o (id? (i_1) ® 
then J(L) = r r (L). We therefore compute T(L). We have 

r(L)(«i ® . . . ® u r _i) 

=(id® (r_1) <8) o (L g) idy) o (id® (r_1) ® C)^ ® . . . ® u r _i <8) 1) 

=(id£ (r-1) (8) o (L <8) idy)(ui g> . . . ® <8> c ) 

=(id® (r ~ 1} g) (8) ... <8> L r -iVr-i <8> ^ LA <g> k) 

i 

=(id® (r ~ 1} <8> CXLiUi (8) ... ® L r _iv r _i ® ^ LA <8> 6j) 

i 

= 2J(L r &j,foj)(LiU 1 (8) ... ® L r _ 1 w r _i) 

i 

=eTr(L r , V^Zo/Wi <8> . . . <8> L r -iV r -i). 

It follows that r(Lj (8) • • • 8>L r ) = eTr(L r , V^Li 8) ... 8) L r _i, and hence by induction 
that J(L) = F r (L) = e r Tr(L, V® r ). The result follows. □ 

4. Theory of invariants of the orthogonal and symplectic groups. 
Henceforth we assume that K is a field of characteristic zero. 

4.1. The fundamental theorems of invariant theory. Let G be either the or- 
thogonal group O(V) or the symplectic group Sp(V). For any t £ N, the space V m 
is a G-module, and hence so is its dual space V® 1 * = Hoiiik^V"®*, K). The space of 
invariants (\Z®'*) G = Hornby®*, K) consists of linear functions on V® 1 which are 
constant on G-orbits. One formulation of the first fundamental theorem of classical 
invariant theory for the orthogonal and symplectic groups [Wl IGW] is as follows. 

Theorem 4.1. The space is zero ift is odd. Ift = 2r is even, any element 

of (V m *) G is a linear combination of maps of the form -y a (a £ Sym 2r ), where 

r 

(4.1) 7a : Vi (8) • - • <8) V 2r JJ(Vo(M-l),«a(2*)), 

i=l 
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Now Sym 2r evidently acts transitively on the set of 7 a through its action on V® r 
by place permutations: for n G Sym 2r , 7r.7 a := 7 Q o 7r _1 = j na . Moreover the 
centraliser H in Sym 2r of the involution (12)(34) . . . (2r — 1, 2r), which is isomorphic 
to Sym r k (Z/2Z) r , clearly takes 71 to ±71. Hence if % '■— Sym 2r /(Sym r k (Z/2Z) r ) 
is a left transversal of Sym r k (Z/2Z) r in Sym 2r , it follows that each function 7^ is 
equal to ±73, with (3 & %, and hence that 



Corollary 4.2. Wii/i notation as in Theorem 4-1, and writing % for the transversal 
above, (y®**) G is spanned by {~y a \ a G %}■ 

Remark 4.3. Note that since % ■— Sym 2r /(Sym r x (Z/2Z) r ) is evidently identified 
with the set of all pairings of the elements of {1,2,..., 2r}, T r is in bijection with 
the diagrams in B r r (em). 

For any subset S C [l,t], let Sym(S') be the symmetric group of S, regarded as 
the subgroup of Sym t which fixes all elements in [1, t] \ S. The next lemma provides 
some linear relations among the j a . 

Lemma 4.4. Let S be any subset of [l,t] with \S\ = m + 1. Then for any 7 = 7 a 
as in (14.11) . we have X]7rGSym(s)( — l)'^'^ = 0. In particular, for a G %, 

(4.2) (-l) H 7«»r = 0- 

7rGSym(5) 

Proof. For any S G [l,i] of cardinality m + 1 and 7 G (V" **) , we have 

(-l) w 7r7(vi®---®v t ) 

7reSym(5) 

= ^ (-l) |7r| 7(7T _1 K«)---®^)) 

(4.3) 7rGSym(5) 

= 7 ( ^ (-I^Itt-V® -••«>%)) 

7r6Sym(S) 

= 0, 

since Sym(5) acts on m + 1 positions, and therefore the alternating sum has a factor 
which is an element of A m+1 (V), which is zero since m = dim(V). □ 

Remark 4.5. (i) When the form is symmetric, the inner sum in the third line of 
Equation (14. 3[) may be zero for the trivial reason that an involution in S might fix 
7. Thus some of the relations above are trivial in the orthogonal case. 

(ii) Although air may not be in T r above, it is always the case that 7 a7r = ±73 
for some f3 G T . Thus the Lemma does provide linear relations among the 7 Q for 
a G T r - 



The second fundamental theorem for the orthogonal and symplectic groups |Wj 
may be stated as follows |GWj . 

Theorem 4.6. Write m = dim(V) and let d — m if G — O(V), and d — y if 
G = Sp(V). If r < d, the linear functions {~y a \ a G %} of Corollary \4 . 2\ form a 
basis of the space of G -invariants on V® 2r . If r > d, any linear relation among the 



functionals j a is a linear consequence of the relations in Lemma\4^4 
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4.2. Categorical generalisations of the fundamental theorems. We now re- 
turn to the category 13 (em) of Brauer diagrams with parameter em (where e = e(G)) 
and the covariant functor F : B(em) — > Tg(V). Recall that the group algebra 
f^Sym r is embedded in the Brauer algebra B r (em) of degree r. In particular, E e (r) 
belongs to E>l(em). Let <ft r = F(E e (r)) G EndGt(V® r ) = H^. Then for any r vectors 
Vi in V, 

<f) r (vi ® V 2 ® • • • <g> V r ) = ( — <g) U CT (2) <g> • • • ® f<j(r)- 

crgSym r 

In particular, if r = m + 1, then r = as an element in H™~f\. 

Definition 4.7. Denote by (E e (m + 1)) the subspace of ®k/B l k (em) spanned by the 
morphisms in B(em) obtained from E e (m + 1) by composition and tensor product. 
Set (E e (m + l)) e k = (E e (m + 1)) n B[(em). 

The first and second fundamental theorems of classical invariant theory for the 
orthogonal and symplectic groups can be respectively interpreted as parts (1) and 
(2) of the following theorem. 

Theorem 4.8. Assume that K has characteristic and write d = m if G = 0(V), 
and d = y if G = Sp(V), where m = dim(V). 

(1) The functor F : B(em) — > 7h(V) is full. That is, F is surjective on Horn 
spaces. 

(2) The map F^ is injective ifk+£ < 2d, and KerFj: = (E e (m+l))| ifk+£ > 2d. 

Proof. It follows from Lemma [3T61 that we have a canonical isomorphism B l k ~ B k+e , 
and the study of Fj: is equivalent to that of F® +e . Hence without loss of generality, 
we may assume that I = 0. When i = 0, the theorem is true trivially when k is odd. 
Thus we only need to consider the case I = and k = 2r. 

(1) . By Corollary 14.21 every element of is a linear combination of functionals 
7 a for a G %. As remarked in Remark I4.3[ the elements of T r are in canonical 
bijection with pairings of the set [1, 2r], i.e. the partitioning of [1, 2r] into a disjoint 
union of pairs. Let D be the diagram corresponding to a G %. Then F(D) = j a . 
Thus F 2 ° r is surjective, and so is also Fj: for all k and £. This proves part (1) of the 
theorem. 

(2) . Note that every (2r, 0) Brauer diagram is mapped by F to a 7 a of the form 
(14. ip . Thus if r < d, then KerF^ = by Theorem 14.61 the second fundamental 
theorem. 

Now consider the case r > d. By Theorem 14.61 it suffices to show that every 
relation of the form (14. 2p arises by applying F^ to an element of (E e (m + l))^- Fix 
a G %, and let D G B® r be the diagram such that F(D) = j a . This is the diagram 
corresponding to a G % by Remark 14.31 

Write la (S) = E w6Syin (5)(- 1 ) H 7«r for the left side of Q)- 
If a G Sym 2r . satisfies {a([l,m + 1])} = S, then Sym(S') = erSym([l, m + 
Now regard Sym 2r as embedded in 5|^(em), and define the element 

£> 5 := H'^oaoioff- 1 

7reSym([l,m+l]) 
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in £?2 r (em). Then 7 a (S) = F(Ds), and since we have 

D s = D o a o S e (m + 1) o a" 1 G (S e (m + 1))^, 

it follows that 7ce (S) G F((E e (m + 1))^). 

By Theorem 14.61 all relations among invariant functionals on l/® 2r are linear 
consequences of the relations j a (S) = 0. Using the bijection between diagrams and 
%, it follows that KerF^ is spanned by elements of the form Ds- 

Conversely, it is evident that (E e (m+l))2 r C KerF^ since (p m +i = F(£ e (m+1)) = 
0. This proves part (2) for r > d, completing the proof of the Theorem. □ 

Remark 4.9. Theorem 14.8( 1) with k = 2r, £ = yields the linear version of FFT, 
while the endomorphism algebra formulation arises from the case k = I = r. The 
equivalence of the two versions is an obvious consequence of Lemma 13.61 

Corollary 4.10. If k + £ <2d, then (E e (m + = 0. 

Proof. Since m+ i = 0, (E e (m + is contained in KerF^. But KerF^ = for 
k + i < 2d, and the lemma follows. □ 

5. Structure of the endomorphism algebra: the symplectic case 

Recall from Section l2~5l that B^(em) is the Brauer algebra of degree r. Thus KerF r r 
is a two-sided ideal of B^(em), and B r r (em) / KerF£ is canonically isomorphic to the 
endomorphism algebra Endc(V (X "') by Theorem 14.8( 2). In order to understand the 
algebraic structure of End-ciV® 1 *) , we need to understand that of KerFf, and this 
is what we shall do in this section and the next section. 

Here we take G = Sp(V) with dimU = 2n and e = — 1. Denote S_i(r) by S(r). 

5.1. Generators of the kernel. For any s < r, there is a natural embedding 
Bg(— 2n) e — >■ B r r (—2n), b i-> b <g> J r _ s , of the Brauer algebra of degree s in that of 
degree r as associative algebras. Thus we may regard B s s {—2n) as the subalgebra of 
Br{—2n) consisting of elements of the form b ® I r - S - 

Let D(p,q) denote the element of the Brauer algebra B%(—2n) of degree k = 
2n + 1 — p + q shown in Figure [121 



Proposition 5.1. Assume that r > n. As a two-sided ideal of the Brauer algebra 
B^(—2n), KerFjT is generated by D(p, q) and *D(p, q) with p + q < r and p < n. 

Proof. Let A be a single (2r, 0) Brauer diagram with r > n. Then F(A) is some 
functional 7 on V® 2r defined by ( 14. ip . For any it G Sym 2r C -B|£(— 2n), A o tt is 
defined. Note that A has only one row of vertices at the bottom, which will be 




Figure 12. 
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labelled 1,2, ...,2r from left to right. Choose a subset S of [1, 2r] of cardinality 
2n + 1 as in Lemma [4.4[ and consider Sym s C Sym 2r C 2n). Define 

(5.1) A s = Aon - 

7reSym s 

Then by Theorem 14. 6[ and equivalently Theorem 14.8( 2). KerF 2 r is spanned by As 
for all A and S. Given As, we define 

A s = A s o (I r <g> U r ) £ B r r {-2n). 

Then KerF^ is spanned by A s for all A and 5* by Lemma [3.6( 2). 

We can considerably simplify the description of KerF^ and KerF r r . There exist 
elements o = (a±, 02) in the parabolic subgroup Sym r x Sym r of Sym 2r , which map 
S to S' = {i + 1, % + 2, . . . , % + 2n + 1} C [1, 2rj for some % < 2r - 2n - 1. Let 
ct^ = *(cr^ 1 ), where * is the anti-involution of B^.(—2n). Then 

(5-2) Asoa-^^^Aoa-^on. 

By appropriately choosing a, we can ensure that A o a^ 1 is of the form shown in 
Figure [131 The vertices labeled by • are those in 5", which all appear in the middle, 




Figure 13. 

and the other vertices all appear at the left end and right end. Here t denotes the 
number of edges in a -1 with both vertices in {1,2, . . . ,i}, and t' that of the 
edges with both vertices in {i + 2n + 2, i + 2n + 3, . . . , 2r}. Note that after such a 
a is chosen, ir e Sym 5 / acting on A o cr -1 permutes only vertices labeled by •. Thus 
every term on the right hand side of (15.21) is of the form Figure [13] with the same t 
and t' . 

Now (Asocr^ 1 )^ can be expressed as Di®D 2) where Di £ B^(—2n) for ri maximal, 
D2 £ Bk(—2n) with k > n satisfying n + k — r. There are several possibilities for 
D2 depending on i, t and t' . Assume i + 2n + 1 > r. If t — t', then D2 is as shown 
in Figure HH If t < t', then D2 = E o (J s <g> D 3 ) for some s, where D3 is as shown 









2n + l 









p 



Figure 14. 

in Figure [HI and E is the product of some ej's composed with a permutation in 
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Sym 2n+1+9 _ p (D 3 and E may not be unique). Analogously, D 2 = (D 3 <g> I s ) o E if 
t > t'. Assume that i + 2n + l < r. Then D 2 = Eo (I Sl <g> S(2n + 1) ® J 82 ) for some £ 
in B%(—2n), and fixed nonnegative integers si and s 2 satisfying s\ + s 2 + 2n + 1 = fc. 

Therefore, KerF r r is generated as a two sided ideal of B r r {—2n) by elements of the 
form of Figure [TH with 2n + 1 + q — p < r. If p > n, we apply the ant i- involution * of 
B%(— 2n) to the element of Figure[H]to obtain the element shown in Figure [T5| which 




Figure 15. 

we denote by D. Recall the element X s> t of Figure [HJ which belongs to Sym s+i , where 
Sym s+t is regarded as embedded in B*+l(— 2n). Then X 2n+ i_ Ptq o D o X 2n+ i^ 2p+qtP 
is of the form shown in Figure [HJ but with p replaced by 2n + 1 — p < n. 

Therefore, we only need to consider Figure [TH with p < n and its * image. Post- 
composing X 2n +i-p,q to Figure [HI turns the latter into the form shown in Figure O 
Since X 2n+1 _ p ^ g is invertible in B^(— 2n), KeiF^ as a two-sided ideal of B r r (—2n) is 
generated by elements of D(p, q) and *D(p, q) with 2n + 1 + p < r and p < n. □ 

5.2. The element $. For each k such that < k < j" 2 ^] , define the element 

= llj=i e «+2-2j of B™+1(— 2n), where -E(O) is the identity by convention. Then 
define 

H fe = £(n + l)£(A;)E(n + l), 
which may be represented pictorially as 









n + 1 






A---A 


n + 1 



Now define the following element of 2n). 



(5.3) 



} J a k E k with a fc 

fc=0 



(2 k k\) 2 (n + 1 -2fc)!' 



Lemma 5.2. ITie element § is a linear combination of Brauer diagrams with inte- 
gral coefficients, thus is defined over the ring Z of integers. 



Proof. We claim that each (2fcfc!)2( ; fc +1 _ 2fc)! 
despite the appearance of the denominator 



This is obvious when k = since 



(n+l)\ 



is an integral sum of Brauer diagrams 
= E(n + 1). 
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For k > 0, we let r := £(n+l)o(7„ +1 _ 2fc (g)?7® fc ) and := (J„ + i_ 2fc ® A® fc )o£(n+l). 
Then = r o /?. It is important to observe that both r and /3 are invariant under 
the interchange of the end points of each A or U and under permutations of the A 
factors or U factors. Thus they are 2 k k\ multiples of Z-linear combinations of Brauer 
diagrams; that is, and are Z-linear combinations of Brauer diagrams. 

It is obvious from the symmetry of E(n + 1) that any permutation of the bottom 
n + 1 — 2k vertices in r does not change r; similarly permutations of the top n+1 — 2k 
vertices in f3 do not change (3. Thus ° ^Fk\ is a (n + 1 — 2k)\ multiple of a Z-linear 
combination of Brauer diagrams. 

This proves the claim, and hence the lemma. □ 

We have the following result. 

Lemma 5.3. The element $ has the following properties: 

(1) ei $ = $ ei = for all et G fl£g(-2n); 

(2) $ 2 = {n + 1)!$; 

(3) *$ = $; 

(4) $ G Keri^+V 

Proof. Part ([3]) follows from the fact that *Ek = 2^ for all fc. Part (T5]) immediately 
follows from ([I]). 

Since *(e$ o $) = $ o e rt+1 _j, we only need to show that ej o $ = for all i in order 
to prove part (CD). In view of the symmetrising property of S(n + 1), it suffices to 
show that e n o $ = 0. Consider (J n _i <g) Ai) o H&, which can be shown to be equal to 



n — 1 



(5.4) 



-4A; 2 



re- 1 



A A 



+ (n + l-2Jfe)(n-2Jfe) 



n+1 



A- fc -A A. 



by using Lemma 12.211 with 5 = —2n. Note that each Brauer diagram summand of 
the first term has n + 1 — 2k through strings, while the summands in the second 
term have n — 1 — 2k through strings. Using (15. 4 j) one shows by simple calculation 
that 

^a fc (/ n _i ® Ax) o S fc = 0. 
Hence (J n _i <8> At) o $ = 0, which implies statement (1). 

To prove part (141) , we note that the trace of ^+1)! * s ec L ua l to the dimension of 
the subspace F{^){y^ n+l ^) } since Z+iv is an idempotent by part (jSJ). In order to 



evaluate tr 



(n+1)! 

^^yj, we first consider tr 



which is given by 



-1 



.n+1 



AAA 



n + 1 




» n+ l (2n-2fc)! 
' (n-1)! 



AAA 



2A- 
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where the last step uses Lemma [2.19( 2) with e = — 1. Using f)2.13p . one can show 
that 



AAA 



2k 



;-i)* 2 



ko2k n\k\ 



(n-k)] 



V7\7 

Putting these formulae together, we arrive at 



tr 



[n + iy. 



ni 
(n-1) 



m 

k=0 



k n 2k 



a k -1 K 2 



k\(2n - 2k)\ 
{n-k)\ 



n±l 



2n 

n 



2k 
1 



There is a binomial coefficient identity stating that the far right hand side is equal 
to zero. Hence F(<§>) is the zero map on V®( n+1 \ □ 

The corollary below follows from Lemma 16.21 and the fact that 7rE(n + l)ir' = 
E(n + 1) for all n, n' G Sym n+1 . 

Corollary 5.4. The element $/(n + 1)! is the central idempotent in S^tJ(— 2n) 
which corresponds to the trivial representation p x of B™+\(—2n) , defined by pi(sj) = 
1 and pi{ei) = for alii. It generates a 1- dimensional two-sided ideal of B™+l(—2n) . 

Remark 5.5. Another formula for + 1)! was given in terms of Jucys-Murphy 

elements in |l.\IDj. 

5.3. The main theorem. Recall the natural embedding of the Brauer algebra of 
degree s in that of degree t for any t > s. 

Definition 5.6. For each r > n, let ($) r be the two-sided ideal in the Brauer 
algebra B^(—2n) generated by $. 

Remark 5.7. A priori, elements such as (I r - q <8> A q <g> I q )(z <S> X qq )(I r _ q (g) U q <S> I q ) 
are not included in (<E>) r even if z G 

We have the following result. 

Lemma 5.8. The element E(2n + 1) belongs to ($)2n+i- 

Proof. Consider B^.(—2n) for r > n. Let E^(k) = E[,=i e r-2j+i, and define 

T(r) fc = E(r)S;(A;)E(r), fc > 1, 

T(r)>fc = linear span of ($) r U {T(r)$ | z > A;}. 

We first want to show that 

(5.5) E(r) eT(rK[r+i-n]. 

From the formula for we obtain 



r!(n + l)!E(r) = E(r) 



\ 



/"] O-k^k 



k=l 



\ 



r— n— 1 



Sfr). 
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Thus S(r) G T(r)>i. 

Note that for any z G T(r — 2/c)>i, £(r)(z <g> l2k)E r r (A;)S(r) belongs to T(r)>fc+i. 
We can always re- write T(r)fc as 



2fc)! 



E(r)(E(r-2fc)(8)/ 2fc )E;(fc)E(r) 



If r — 2/c > n, then S(r — 2fc) G T(r — 2fc)>!. This implies that T(r)^ G T(r)>fc +1 if 
r — 2k > n. Hence T(r)>! = T(r)> 2 = ■ • • = TfrKj v+i-n i , and (15.51) is proved. 

Now consider S(2n + 1). It follows from (15.51) that S(2n + l) 2 can be expressed 
as a linear combination of elements in (<l>) 2n+ i and also elements of the form 

S(2n + l)Et+W)mn + l)E 2 2 ; t + 1 1 (j)S(2n + 1), ij>l + 



n 

L2J 



Using the symmetrising property of S(2n + 1), we can write this element as H(2n + 
l)(7 2n+ i_ 2i ® £/i)%(/ 2n+ i- 2j - <8> A,)£(2n + 1) with 



(i2n+l-« ® A)S(2n + l)(/2n+l-5 



^0 



By Corollary SHU % = for all i,j > 1 + [f]. Hence S(2n + l) 2 belongs to 
($) 2n+ i, and so does also £(2n + 1). □ 

The following is one of the main results of this paper. 

Theorem 5.9. The algebra homomorphism F£ : B^{— 2n) — > Honis p (y)(U® r , V® r ) 
is injective if r < n. If r > n + 1, then KerF,^ is the two-sided ideal of the Brauer 
algebra B^(—2n) which is generated by the element $ defined by (15.31) . 

Proof. Only the second statement requires proof. Thus we assume that r > n + 1. 
Consider first the case r = n + 1. Then there is only one D(p, q) with p = n and 

g = (see Figure [T2l). Using S(n + 1) = $ — ^LJ, we have 

D(n,0)$ 



n+l 
2 



D(n,0) 



(n + l)! 



k=i 



£(n,0)~ fc 



(n + l)! 



Note that 



£>(n,0)5 fc 
(n+l)! 



n 


2n + 1 




A \ \ 


n + l 









where the dotted-line indicates that the diagram is the composition of the two 
diagrams above and below the line. The diagram above the dotted line is the tensor 
product of an element in (£(2n + 2fc with I„. Since (£(2n + l)) n+ i- 2 fc = 

for all k > 1 by Corollary KM we have D ffffi = 0. This proves D(n, 0) G ($)n+i- 
Now we use induction on r to show that the theorem holds for r > n + 1. If 
p = 0, the diagram corresponds to S(2n + 1), which belongs to ( < l ) ) 2 n+i by Lemma 
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15.81 Assume n > p > 1 , and let r = 2n + l— p + q. Consider D (p, q) o £ (2n + 1 — p) 
by using the the formula 

/ m \ \ 



E(2n + 1 -p) 



V 



k=l 



L n—p 



) 



£(2n + l -p) 



J 



71 + 1 ! 



We obtain an expression for D(p, q) of the form 

(5.6) D(p,q) = J2^D(p,q;k) + D°, 



k>l 



where Ck are scalars, D° G ($) r , and 



D(p,q; k) 





P ~ 1 _~ 


2n + 1 




A* A V- 


2n + l-% 


> 







The diagram D(p, q; k) is the composition of 



D' 





p-q ^ 


2n + l 







with the following element of B r (—2n) 




Note that D' belongs to kerF r _!. Thus D' G ($) r -i by the induction hypothesis 
and it follows that D(p,q; k) G ($) r - This completes the proof. □ 

Remark 5.10. Any element which generates the kernel Keri^™^ 1 = ($) n+ i must be a 
nontrivial scalar multiple of $. It was proved in [HXJ that for all r > n + 1, KerF r r 
is generated by a single generator belonging to KerF™^ 1 . Therefore, our $ provides 
an explicit formula for this generator (up to a scalar multiple). 
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6. Structure of the endomorphism algebra: the orthogonal case 

We now study the algebraic structure of KerF r r in the case of the orthogonal 
group. Throughout this section, we take G = 0{V) with dimV^ = m and e = 1. 

6.1. Generators of the kernel. For p — 0, 1, . . . , m + 1, let E m+ i_ p denote the 
element of the Brauer algebra (m) of degree m + 1 shown in Figure [TBI 



1 — p 



P 

Figure 16. 

Lemma 6.1. For all < k < m + 1, the elements are linear combinations of 
Brauer diagrams over Z. 

This is evident from the definition of these elements. They also have the following 
properties. 

Lemma 6.2. (1) *E P = E m+ i^ p for all p. 

(2) F P E P = E P F P = p\(m + l-p)\E p . 

(3) eiE p = E p ei = for all i < m. 

Proof. Both (1) and (2) follow easily from the pictorial representation of E p given 
in Figure [16j If i ^ p, then eiF p = F p Ci = 0. Thus (3) holds for all i ^ p. The % = p 
case of (3) follows from the fact that 







r 


m + 











= o, 



which is implied by Lemma [2.19( 2) when r = m + 1 and e = 1. □ 

The arguments used in the proof of |LZ4[ Corollary 5.13] lead to 

Corollary 6.3 ( |LZ4j ). Let D be any diagram in B™+l(n) which has fewer than 
m + 1 through strings. Then DEi = E^D = for all i. 

Note that E = E m+ i = S +1 (m + 1). 

Proposition 6.4. Assume r > m. As a two-sided ideal of the Brauer algebra 
B r r {m), KerF^ - is generated by E p for all < p < m + 1 . 

Proof. The proof of Proposition 15.11 can easily be modified to prove the assertion 
above. The two required modifications are that for any (2r, 0) tangle diagram A 
with associated invariant functional 7 = F(A), (i) the definition (15. ip of As needs 
to be changed to 

a s = J2 (- 1 ) w ^ 07r ; 

7rGSym s 
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(ii) we only need to consider subsets S of [1, 2r] which will not lead to the trivial van- 
ishing of As discussed in Remark 14.51 (i). With these modifications, the arguments 
following (15. ip may be repeated verbatim, leading to the conclusion that KerF r r is 
generated as a two-sided ideal of Bl(—2n) by elements of the form Figure [T71 









m + 1 









Figure 17. 

Post-multiplying the diagram in Figure [T7] by the invertible element X m+ i_ PiP , 
we obtain Figure [16] up to a sign. This completes the proof. □ 

Remark 6.5. Figure [T7] is the p = q analogue of Figure [HJ In the present case, 
diagrams of the form Figure H~4l with p > q vanish identically, since S +1 (m + 1) is 
the total antisymmetriser in Sym m+1 . 

6.2. Formulae for the E^. If k, I are integers such that 1 < k < I, write A(k, I) : = 
£ + i(Symr A)fe+1) __ n) for the total antisymmetriser in Sym{ fcA , +1 n. By convention, 
A(k, I) = 1 if k > I. Represent A(l, t)A(t + 1, t + s) in B^{(m) pictorially by 



The lemma below is the graphical reformulation of some of the computations in the 
proofs of |LZ4[ Corollary 5.2] and |LZ4[ Theorem 5.10]. 



Lemma 6.6. For all k = 0,1, ... ,i 



(6.1) 



i - 1 



i 




m + 1 — i 


= k 2 


i - 1 




m — i 


+ (i,k 
























i — 


k 




j 





where j = m + 1 - % - k and Q,k = ^k-^m-i-kr 



Proof. When k = 0, (16. ip is an identity. 



BRAUER CATEGORY AND INVARIANT THEORY 

We use Lemma [2.19( 1) twice to obtain 



31 



(6.2) 





1 


t 




\ 



t- 1 



s - 1 



+ 



t-1 


s - 1 








t- 1 


s - 1 



where 



ipt,s = m + 2-t- s 



1 



, Vty 



(t - 2)\(s - 2)\- 

The case k — 1 of (16. ip can be obtained by setting t — i and s = m + 1 — i. 

Now use induction on k. Post-composing U-k-i <S> U <S> I m -i-k to (16. ip we obtain 





















i - 1 




m — i 


i m + 1 — i 


= A; 2 


i - 1 




m — i 


+ (i,k 










fc+i 








k 






i — 


k 




j 











By using (16. 2p in the bottom half of the second diagram on the right hand side, we 
obtain (16. ip for k + 1, completing the proof. □ 

Following |LZ4l §4.2], we introduce the elements of B™^l(m) below. For p = 
0, 1, . . . , m + 1, let 

F p := A(l,p)A(p + l,m + l), 

where F is interpreted as A(l,m + 1). For j = 0,1,2, ... ,i, define = 
ei ]i+ iej_i i j + 2 • • • ei-j + ij + j. Note that ej(0) = 1 by convention. We have the following 
formulae for the E{. 

Lemma 6.7. For i — 0, 1, . . . , m + 1, let mini = min(i, m + l — i). Then 

mini 



(6.3) 



£i = ^(-l) J Q(j)H*(j) with Ei(j) = F iei (j)F i; 

3=0 



where q(j) = ((i — j)\(m+ 1 — i — j)! (j!) 2 ) 1 . 

Remark 6.8. For < i < , the lemma states that the Ei are the elements 

defined in [LZ41 Definition 4.2] with the same notation. 

Proof. We have *H i (j) = H m+1 _i(j). For i < [f ] , 

tmirii \ mini 

Y,(-i) j ci(m(j)) = ^(-iyc m+1 _,(j)H m+1 _,(j), 
3=0 J 3=0 



since Cj(j) = c m+ i_j(j). Therefore, equation (16. 3p will hold for all i by Lemma 
16.2( 1). if we can show that it holds for < i < [y] . This will be done in two steps. 
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(i) . We first show that for each i < [y], there exist scalars Xi(j) such that 

i 

3=0 

The case % = is obvious as we have Eq — A(l,m+ 1). Thus we only need to 
consider the case with i > 1. 

Let us label the vertices of Ei (see Figure [TBI) in the bottom row by 1, 2, . . . , m + 1 
from left to right, and those in the top row by 1', 2', . . . ,(m + 1)' from left to right. 
Let L = {1, 2, . . . , i}, R = {i + 1, i + 2, . . . , m + 1}, V = {V, 2',..., i'} and R! = 
+ 1)', {i + 2)', . . . , (m + 1)'}. Since A(l, m + 1) has through strings only, a Brauer 
diagram in Ei can only have the following types of edges (an edge is represented by 
its pair of vertices) 

(a,t)ELxR, (a',f) e L' x R', 
(a',b)eL'xL, (s',t)eR'xR, 

and the numbers of edges in L x R and in V x R' must be equal. Thus it follows 
Lemma \6. 2( 2) and the antisymmetrising property of A(l, i) and A(i + 1, m + 1) that 
Ei is a linear combination of 

(ii) . To determine the scalar Xj(0), we observe that the terms in A(l, m + 1) which 
do not contain S{ make up F$ = A(l, i)A(i + 1, m + 1). Note that 



p 



Thus Xi(0)~i(0) = A(l,i)A(i+l,m+l), and hence ar^O) = (^(m + l-z)!)" 1 = Ci (0). 

Now we determine the Xi(k) for all fc > 0. By Lemma [6.2( 3). = 0. Using 
(16. ip in this relation, we obtain 

(k + l) 2 Xi{k + 1) + (i - k)\{m + 1 - i - k)\Q tk Xi{k) = 0, < k < i. 

The recurrent relation with x,(0) = Cj(0) yields Xi(k) = (— l) J q(fc). □ 

The following result is an easy consequence of Lemma 16.71 Recall the elements 
X Sjt G Sym s+t shown in Figure El 

Corollary 6.9. For all i — 0, 1, . . . , m + 1, we have Ii )m+ i_i£il m+ i_y = i? m+ i_j. 

Proof. It is easy to show pictorially that X^M+i-i^ii^Xm+i-i^ = ^m+i-i(j) for all 
j < i. Since Cj(j) = c m+ i_j(j), this proves the claim of the corollary. □ 

6.3. The main theorem. The following theorem is Theorem 4.3 in [LZ4|, which 
is the main result of that paper. 

Theorem 6.10 ([L"Z3]). The algebra map F r r : B r r {m) — > Rom (v)(V® r , V® r ) is 
injective if r < m. If ' r > m, the two-sided ideal KerF r r of the Brauer algebra B r r {m) 
is generated by the element E = Ei with I = f 12 ^] • 
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Proof. Only the second part of the theorem needs explanation. By Proposition 16.41 
and Corollary 16.91 the elements Ei with i = 0,1,... £ = [^j^-] generates KerFf. 
Using some general properties of the symmetric group and Corollary 16.31 we showed 
in |LZ4| §7] that is contained in the ideal generated by Ei for each i — 1, . . . , i. 
The theorem follows. □ 



7. The case of positive characteristic 

The following statement is an immediate consequence of |RS| Theorem 2.3]. 

Lemma 7.1. Let n,r G Z >0 . The following are equivalent for the Brauer algebras 
over Z. 

(1) The Brauer algebra B r (n) is semisimple. 

(2) The Brauer algebra B r (—2n) is semisimple. 

(3) r < n + 1. 

It follows from this that n+1 is the largest value of r such that B r (n) and B r (—2n) 
are semisimple. The idempotents we have found are thus each in the 'last' Brauer 
algebra which is semisimple. This is in complete analogy with the situation in the 
Temperley-Lieb algebra when q is a root of unity, where the radical of the Jones 
trace function is the idempotent corresponding to the trivial representation of the 
'last' semisimple Temperley-Lieb algebra (see |GL96[ Cor. 3.7, Remark 3.8]). 

Note that our basic setup in this paper remains the same over the ring Z of inte- 
gers. Since we will deal with the orthogonal and symplectic groups simultaneously 
in this section, we write the functor F as F t : B(em) — > Tg(V), and F l k as F l ek 
for easy reference. Recall that m = dimV and e = — 1 if G — Sp(V) and e = 1 if 
G = Oiy). We also set d = m/2 if e = —1, and d — m if e = 1. 

By Lemmas 15.21 and 16. 11 the element $ defined by equation (15.31) and the elements 
Ek (0 < k < f 12 ^-]) of Lemma [6.21 are linear combinations of Brauer diagrams over 
Z. 

Lemma 7.2. We have $ 6 KerF^ 1 r and Ek G KerF^,, (for all k ) over any field K . 

Proof. For the elements Ek, the claim immediately follows from their definition and 
of Theorem 17.31 (2). It was also proved in |LZ4j . 

Next note that by Lemma 15.21 $ is defined over Z. It follows from Lemma 17.11 
that B r (—2n) is semi-simple over K, and KerF^ lr is the 2-sided ideal of B r (—2n) 
corresponding to the one-dimensional simple module. The element $ is a central 
quasi-idempotent contained in this 2-sided ideal. □ 

The following result is a generalisation of Theorem 14.81 to fields of positive char- 
acteristic. 

Theorem 7.3. Over any field K of characteristic char(K) > m + 2, 

(1) the functor F t : B(em) — > 7b(V) is full; 

(2) the map F[ k is infective ifk+£ < 2d, andKerF^ k = (E e (m+l)) e k ifk+£ > 2d. 

Proof. In the orthogonal case, this was proved in |LZ4l Theorem 9.4] as an appli- 
cation of [H Prop. 21]. Although the symplectic case is surely in the literature, 
we have been unable to find it, and therefore provide the following sketch of the 
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argument, which may be found in |ALZj . Note that it provides a proof of the second 
fundamental theorem in positive characteristic for the symplectic groups. 

Let R = Z[((m + l)!) -1 ]. Then we may consider the symplectic Lie algebra <5r 
over R, and the corresponding i?-forms Vr and Br = (B r (—m))R. Note that by 
Lemma [5.21 we may regard $ as an element of Br. It is shown in [ALZJ, that if M 
is a tilting module for &r and K is a field with <ft : R — > K a ring homomorphism, 
then End® k (M®rK) ~ End® R (M) ®rK. It also follows from loc. cit. that V r ®Vr 
is a tilting module. This implies (cf. jALZl Cor. 3.4]) that dim K (B R / '($)) ® R K = 
dim c (5 r (-m)/($)) = dimEnd (SK (V / f lr ), and the result follows. □ 

Scholium 7.4. Let K be a field of characteristic char(K) > m + 2. Then the 
kernel of the algebra homomorphism i<J r : B r (em) — > EndciV^ 1 ") as a two-sided 
ideal in the Brauer algebra is generated by $ in the case of the symplectic group 
(i.e.,e = —1), and by E = En with t = f 2 ^-] in the case of the orthogonal group 
(i.e., e = 1). 

Remark 7.5. Recent results of Hu and Xiao show that Scholium 17.41 is valid for all 
fields K such that char(K) > 2. 



8. Quantum analogues. 

8.1. Background. Let XJ q + (resp. U g ~) be the quantised enveloping algebra in the 
sense of \LZ1\ §6] of the Lie algebra o m (C) (see |LZ1[ 8.1.2] for the definition) (resp. 
sp, m (C)), over the field K = C(g), where in the latter case we require that m = 2n is 
even. Write A q for the subring of C(q) consisting of rational functions with no pole 
at q = 1. Denote by V q = K m the quantum analogue of the natural representation 
of XJ q . The study of the endomorphism algebras Endu 9 (V^ r is closely analogous to 
the classical case we have been considering, which may be thought of as the limit as 
q — > 1 of the quantum case, in a way we shall shortly make precise. 

In particular, there are homomorphisms from certain specialisations of the Birman- 
Murakami-Wenzl algebra BMW r (g) to Endu^V^ 8 ""), and the classical case is essen- 
tially the limit of the quantum case in the sense that lim^i BMW r (g) = B r , the 
Brauer algebra. Let us recall the details (see [LZ21 §4]). Let y, z be indeterminates 
over C and write A = C[y ±:L ,2;]. The BMW algebra BMW r (y, z) over A is the 
associative ^4-algebra with generators g^ 1 , . . . , and ei, . . . , e r _i, subject to the 
following relations: 

The braid relations for the 

, gl , 9i9j = 9j9i if > 2 

9i9i+i9i = 9i+igi9i+i for 1 < % < r - 1; 

The Kauffman skein relations: 

(8.2) g { - g,-r x = z(l - e^) for all i; 
The de-looping relations: 

9i^i &i9i V^ii 

(8.3) e ig t\ei = y^e,- 

e i9i+l e i = e i- 
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The next four relations are easy consequences of the previous three. 



(8.4) eiti±\ti = e»; 

(8.5) ( gi -y)(gf-z gi -l) = 0; 

(8.6) ze 2 i =(z + y- 1 -y)e t , 

(8.7) -yzei = g\ - zg { -l. 



It is easy to show that BMW r (y, z) may be defined using the relations (18.11) . (18.31) . 
fl83|) and (JEU) instead of (JHTTD , ([872]) and (jOj) . i.e. that (JH^D is a consequence of 
fl83|) and (18771) . 

8.2. Specialisations and integral forms. Now in both the orthogonal and sym- 
plectic cases, V q is the simple Uq-module correponding to the highest weight E\ 
using the standard notation for the weights as in [Bour] . and we have the following 
decomposition of V q 2 \ 

(8.8) V q ® V q = L 2£l © L £l+£2 © L , 

where L\ is the simple module corresponding to the dominant weight A, and L is the 
trivial module. The eigenvalues of the i?-matrix R on these respective components 
are as follows (see |LZll (6.12)]): 

U 9 (0 m ) :q--q- l -q l - m 

U,(spJ : q^-q- 1 ;^- 1 - 171 

Now define two C-algebra homomorphisms ip^ 1 : A — > A q as follows. ip + (y) = 
q l ~ m ) ip + (z) = q — q~ l , i>~(y) = — g _1 ~ m , ip~(z) = q — q~ x . We then obtain 
two ^-algebras BMW^(g) := A q ©^± BMW r (y,z), and we write BMW^(/C) : = 
K, © t BMW^(g), where i is the inclusion of A q into /C. 

It follows from (18.61) that in these two specialisations, we have e\ = 5 ± (q)ei, where 
S + (q) = [m— l] q + 1 and d~~(q) = — ([m + l] q — 1). Here we use the standard notation 
for g-numbers: for any integer t, [q] t = q q ~ Q -i ■ 

It is a consequence of |LZ1| Theorem 7.5] that we have surjective homomorphisms 

(8.9) BMW±(/C) ^ End Vq ±{V® r ). 

To relate the above statement to the classical (q = 1) case, it was shown in 
[LZT1 §8.2] that XJ q and the modules V® r have Ag-fouas U ?(A)> v ® r {A) such that 
XJ q (A q ) acts on V® r (Aj), and the projections to the components in (18 .8p are defined 
over A q , so that the decomposition (18. 8 p is compatible with the A q forms. We may 
therefore take lim 9 _>i := C ©^ — of all Aj-modules in (I8.9p . where ipi '■ A q — > C 
takes q to 1. It is well known that lim^^U q ) = sp m (C) if e = —1, and o m (C) if 
e = +1, and that lim, J _ >1 (BMW^.(g)) = B r (em). In the proof of the next result we 
shall make extensive use of the cellular structure of BMW^.(g) and its relationship 
to the cellular structure of B r (em), as described in \LZ2\ Proposition 7.1]. 

We therefore recall the following facts from loc. cit.. 

Lemma 8.1. (cf. [LZ2, Proposition 7.1}) 

(1) For each r, the algebras BMW^.(g)) and B r (em) have a cellular structure with 
the same cell datum (A,M,C). 
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(2) The structure constants of B r (em) are obtained from those ofBMW e r (q)) by 
putting q = 1 . 

(3) For each A G A, denote the cell module o/BMWJ;(g)) by W q (X) and that of 
B r (em) by W{\). Then W(X) = lim^i W q (X)(= C <8>^ W q {X), the Gram 
matrix of the canonical form on W(X) is obtained from that of W q (X) by 
setting q = 1, as is the matrix of of lim q ^i b G B r (em) from that of b. 

The main result of this section is the following. 

Theorem 8.2. (i) With notation as above, suppose $ is an idempotent in B r (em) 
such that the ideal ($) is equal to Ker(r^ : B r (em) — > EndG(V® r ))- Suppose that 
$ g G BMW;(g) is such that 

(1) $2 = f(q)$ g where /(g) G A q . 

(2) lim g ^i $ 9 = c$ ; where c^O. 

Then $ 9 generates Ker(r] q : BMW^(g) — ► End Ufl (V® r ))- 

(ii) In the symplectic case, BMWL_ 1 (/C) is semisimple, and the kernel ofrj q is gen- 
erated by the idempotent corresponding to the trivial representation o/BMW d+1 (/C), 
where m = 2d. 

(Hi) In the orthogonal case, there is an idempotent in BMW^ +1 (g) which generates 
Ker(?7g). 

Proof. It is clear from Lemma 18.11 that rank_4 > dimc($) (this follows also 

from the fact that lim^i (BMW;(g)$,BMWJ(g)) = B r (em)$B r (em)), and hence 
that dim /c (BMW'(/C)/($ g )) < dim c (B r (em) /($)). It follows that if we knew that 
$ g G Ker(r] q ), then 

dimc(B r (em)/<$)) > di mK; (BMW r e (/C) /($,)) 

> dimyc(BMW^(/C)/Ker(^)) = dim c (5 r (em) /($)), 

whence (i) follows. Hence we turn to the proof that Q q G Ker(?y 9 ). 

Let M q = V® r , and M = V® r = lim g ^i M g . We wish to show that ® q M q = 0. 
Now lim 9 _rt $,M, = c$M = 0. It follows that $,M, C (q - l)M q . We shall show 
that <& q M q C (g — l) l M g for each integer z, which will show that § q M q = 0. 

Assume that $ q M q C (g — 1) 4 M,; then operating by $ ? , we obtain $^M, = 
f(q)$ q M q C (g - l) i+1 M 9 . But /(g) is not divisible by g - 1, since lim^i $jj = 
c 2 $ = /(1)$ ^ 0. Hence <& g M 9 C (g - l) i+1 M 9 , and it follows by induction that 
§qM q C (g — l) l M q for all i, completing the proof of (i). 

(ii) We are in now the symplectic case, and by Theorem 15.91 the idempotent 
$ G -B c f + i(— m) which corresponds to the trivial representation generates Ker(?7). 
Since the Gram matrix G(W(A)) of the cell module W(X) of Bd+i(— m) is obtained 
from the Gram matrix G(W q (X)) of the corresponding cell module of BMW^" +1 (g) 
by taking lim^i, it follows that since the former is non-singular for each A, so is the 
latter. Hence BMW ( L_ 1 (g) is semisimple. Hence there is a central idempotent $ g G 
BMW d+1 (/C) which corresponds to the trivial representation. This is characterised 
by the property that e^ q = $ g ej = and gi<& q = Q q gi = q$ q for all i. Now there 
is an element /(g) G A q such that f(q)$ q G BMW rf+1 (g) and /(l) ^ 0. Write 
$ ? = /(g)$ 9 . Using an argument by descent similar to that used above, it is easily 
shown that lim^i $ 9 ^ 0, i.e. $ g £ (q - l)BMW^ +1 (g). 
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If we write a, G B r (—m) for the transposition + 1), then with a slight abuse 
of notation, we have ]im q -+x(gi) = oi and lim^i e, = e^. Taking limits, the relations 
above show that $1 := lim^i $ g is central in Bj+i (— m) and satisfies e^i = $ie, = 
and <Jj$i = $io~i = $i for all i. It follows that $i = c$, for some non-zero scalar 
c, and hence by (i), that $ 9 generates Ker(r} q ). 

(iii) In the orthogonal case, it follows from Theorem 16 . 1 01 that Ker(r/) is generated 
by an idempotent element $ G B m+ i(m), which may be taken to be a scalar multiple 
of Eg. Now B m+ i(m) is semisimple, and hence there are primitive central idempo- 

tents ii, . . . , I s G 5 m+ i(m) such that I a H h J s = 1. Hence $ = $ii H h 

Suppose without loss of generality that $ij ^ if j < t, and = if j > t. Then 
the ideal genrated by $ is equal to that which is generated by ^ := 1% + • • • + I t . 
For clearly ($) C (Ix + • • - + I t ), but conversely if 7^ 0, the two sided ideal 
generated by $Jj includes the simple ideal generated by Ij, and hence Ij itself. So 
(/! + ••• + /*) C (7 1 ,...,J t ) C($). 

We shall show that there is an element ty q G BMW^ +1 (g) with properties analo- 
gous to those of & q in (i), but for \1>. First observe that by the same agrgument as 
in (ii) (using Lemma fSTTT) the algebra BMW^ +1 (g), and hence BMW^ +1 (/C), whose 
cell modules have the same Gram matrices, are semisimple. It follows that there 
are unique primitive central idempotents . . . , $t,q £ BMW^ +1 (/C) which cor- 
respond to the same cells as $1, . . . , $t respectively (recall that A parametrises the 
cells of both BMW^ +1 (/C) and B m+ i(m), and hence also their minimal two-sided 
ideals). For each i, there is an element fi(q) G A q such that fi{q)^i yq G BMW^ +1 (g). 
Using the same argument as in (ii), fj(q) may be chosen so that lim g _ > i(/j(g)\E'j q ) = 
f 5 {l)Ij ^ 0. Then : = f x (q)f 2 {q) . . . f t (q)($x, q + ■■■ + $ t ,,) G BMW+ +1 (<?),' and 
satisfies: (i) ^ 2 q = F(q)V q , where F(q) = f^q) . . . f t (q) and (ii) lim^tf,) = 
It now follows from (i) that ^ q generates Kei(r] q ). □ 

We remark finally that Hu and Xiao |HXj have also contributed to the subject of 
this section. 



8.3. Further comments. The invariant theory of quantum groups [Dl[L] in a broad 
sense has been extensively studied. One aspect of it is the quantum group theoretical 
construction [Rj[RTj[ZUB] (see [T2 ] for a review) of the Jones polynomial of knots [J] 
and its cousins. It was in this context that the braided monoidal category structure 
of the category of quantum group representations rose to prominence. 

In the quantum case, the right replacement of the category of Brauer diagrams is 
the category of (nondirected) ribbon graphs [RT] IT2] , also known as the category 
of framed tangles. The Reshetikhin-Turaev functor [RTJ gives rise to a full tensor 
functor from this category to the category of tensor representations of the symplectic 
quantum group, or the orthogonal quantum group defined in [LZlJ. This is the 
quantum analogue of Theorem 14.8( 1). 

The FFT of invariant theory for quantum groups is best understood in terms 
of endomorphism algebras (see e.g., |DPSj ILZlj ). However, in order to establish a 
quantum analogue of FFT in the polynomial formulation, one has to go beyond com- 
mutative algebra and consider quantum group actions on noncommutative algebras. 
This was developed in [LZZJ. 
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